NorthStar, a support tool for the design and evaluation of quality improvement interventions in healthcare

Background: The Research-Based Education and Quality Improvement (ReBEQI) European partnership aims to establish a framework and provide practical tools for the selection, implementation, and evaluation of quality improvement (QI) interventions. We describe the development and preliminary evaluation of the software tool NorthStar, a major product of the ReBEQI project. Methods: We focused the content of NorthStar on the design and evaluation of QI interventions. A lead individual from the ReBEQI group drafted each section, and at least two other group members reviewed it. The content is based on published literature, as well as material developed by the ReBEQI group. We developed the software in both a Microsoft Windows HTML help system version and a web-based version. In a preliminary evaluation, we surveyed 33 potential users about the acceptability and perceived utility of NorthStar. Results: NorthStar consists of 18 sections covering the design and evaluation of QI interventions. The major focus of the intervention design sections is on how to identify determinants of practice (factors affecting practice patterns), while the major focus of the intervention evaluation sections is on how to design a cluster randomised trial. The two versions of the software can be transferred by email or CD, and are available for download from the internet. The software offers easy navigation and various functions to access the content. Potential users (55% response rate) reported above-moderate levels of confidence in carrying out QI research related tasks if using NorthStar, particularly when developing a protocol for a cluster randomised trial Conclusion: NorthStar is an integrated, accessible, practical, and acceptable tool to assist developers and evaluators of QI interventions

Technology for large-scale translation of clinical practice guidelines : a pilot study of the performance of a hybrid human and computer-assisted approach

Background: The construction of EBMPracticeNet, a national electronic point-of-care information platform in Belgium, was initiated in 2011 to optimize quality of care by promoting evidence-based decision-making. The project involved, among other tasks, the translation of 940 EBM Guidelines of Duodecim Medical Publications from English into Dutch and French. Considering the scale of the translation process, it was decided to make use of computer-aided translation performed by certificated translators with limited expertise in medical translation. Our consortium used a hybrid approach, involving a human translator supported by a translation memory (using SDL Trados Studio), terminology recognition (using SDL Multiterm termbases) from medical termbases and support from online machine translation. This has resulted in a validated translation memory which is now in use for the translation of new and updated guidelines. Objective: The objective of this study was to evaluate the performance of the hybrid human and computer-assisted approach in comparison with translation unsupported by translation memory and terminology recognition. A comparison was also made with the translation efficiency of an expert medical translator. Methods: We conducted a pilot trial in which two sets of 30 new and 30 updated guidelines were randomized to one of three groups. Comparable guidelines were translated (a) by certificated junior translators without medical specialization using the hybrid method (b) by an experienced medical translator without this support and (c) by the same junior translators without the support of the validated translation memory. A medical proofreader who was blinded for the translation procedure, evaluated the translated guidelines for acceptability and adequacy. Translation speed was measured by recording translation and post-editing time. The Human Translation Edit Rate was calculated as a metric to evaluate the quality of the translation. A further evaluation was made of translation acceptability and adequacy. Results: The average number of words per guideline was 1,195 and the mean total translation time was 100.2 min/1,000 words. No meaningful differences were found in the translation speed for new guidelines. The translation of updated guidelines was 59 min/1,000 words faster (95% CI 2-115; P=.044) in the computer-aided group. Revisions due to terminology accounted for one third of the overall revisions by the medical proofreader. Conclusions: Use of the hybrid human and computer-aided translation by a non-expert translator makes the translation of updates of clinical practice guidelines faster and cheaper because of the benefits of translation memory. For the translation of new guidelines there was no apparent benefit in comparison with the efficiency of translation unsupported by translation memory (whether by an expert or non-expert translator

Clinical practice guidelines: towards better quality guidelines and increased international collaboration

Item does not contain fulltex

Rationale, design and conduct of a comprehensive evaluation of a primary care based intervention to improve the quality of life of osteoarthritis patients. The PraxArt-project: a cluster randomized controlled trial [ISRCTN87252339]

BACKGROUND: Osteoarthritis (OA) has a high prevalence in primary care. Conservative, guideline orientated approaches aiming at improving pain treatment and increasing physical activity, have been proven to be effective in several contexts outside the primary care setting, as for instance the Arthritis Self management Programs (ASMPs). But it remains unclear if these comprehensive evidence based approaches can improve patients' quality of life if they are provided in a primary care setting. METHODS/DESIGN: PraxArt is a cluster randomised controlled trial with GPs as the unit of randomisation. The aim of the study is to evaluate the impact of a comprehensive evidence based medical education of GPs on individual care and patients' quality of life. 75 GPs were randomised either to intervention group I or II or to a control group. Each GP will include 15 patients suffering from osteoarthritis according to the criteria of ACR. In intervention group I GPs will receive medical education and patient education leaflets including a physical exercise program. In intervention group II the same is provided, but in addition a practice nurse will be trained to monitor via monthly telephone calls adherence to GPs prescriptions and advices and ask about increasing pain and possible side effects of medication. In the control group no intervention will be applied at all. Main outcome measurement for patients' QoL is the GERMAN-AIMS2-SF questionnaire. In addition data about patients' satisfaction (using a modified EUROPEP-tool), medication, health care utilization, comorbidity, physical activity and depression (using PHQ-9) will be retrieved. Measurements (pre data collection) will take place in months I-III, starting in June 2005. Post data collection will be performed after 6 months. DISCUSSION: Despite the high prevalence and increasing incidence, comprehensive and evidence based treatment approaches for OA in a primary care setting are neither established nor evaluated in Germany. If the evaluation of the presented approach reveals a clear benefit it is planned to provide this GP-centred interventions on a much larger scale

Does a joint development and dissemination of multidisciplinary guidelines improve prescribing behaviour: a pre/post study with concurrent control group and a randomised trial

BACKGROUND: It is difficult to keep control over prescribing behaviour in general practices. The purpose of this study was to assess the effects of a dissemination strategy of multidisciplinary guidelines on the volume of drug prescribing. METHODS: The study included two designs, a quasi-experimental pre/post study with concurrent control group and a random sample of GPs within the intervention group. The intervention area with 53 GPs was compared with a control group of 54 randomly selected GPs in the south and centre of the Netherlands. Additionally, a randomisation was executed in the intervention group to create two arms with 27 GPs who were more intensively involved in the development of the guideline and 26 GPs in the control group. A multidisciplinary committee developed prescription guidelines. Subsequently these guidelines were disseminated to all GPs in the intervention region. Additional effects were studied in the subgroup trial in which GPs were invited to be more intensively involved in the guideline development procedure. The guidelines contained 14 recommendations on antibiotics, asthma/COPD drugs and cholesterol drugs The main outcome measures were prescription data of a three-year period (one year before and 2 years after guideline dissemination) and proportion of change according to recommendations. RESULTS: Significant short-term improvements were seen for one recommendation: mupirocin. Long-term changes were found for cholesterol drug prescriptions. No additional changes were seen for the randomised controlled study in the subgroup. GPs did not take up the invitation for involvement. CONCLUSION: Disseminating multidisciplinary guidelines that were developed within a region, has no clear effect on prescribing behaviour even though GPs and specialists were involved more intensively in their development. Apparently, more effort is needed to bring about change

Haemorrhagia post partum; an implementation study on the evidence-based guideline of the Dutch Society of Obstetrics and Gynaecology (NVOG) and the MOET (Managing Obstetric Emergencies and Trauma-course) instructions; the Fluxim study

Contains fulltext : 88435.pdf (publisher's version ) (Open Access)BACKGROUND: One of the most important causes of maternal mortality and severe morbidity worldwide is post partum haemorrhage (PPH). Factors as substandard care are frequently reported in the international literature and there are similar reports in the Netherlands. The incidence of PPH in the Dutch population is 5% containing 10.000 women a year. The introduction of an evidence-based guideline on PPH by the Dutch society of Obstetrics and Gynaecology (NVOG) and the initiation of the MOET course (Managing Obstetrics Emergencies and Trauma) did not lead to a reduction of PPH. This implies the possibility of an incomplete implementation of both the NVOG guideline and MOET-instructions. Therefore, the aim of this study is to develop and test a tailored strategy to implement both the NVOG guideline and MOET-instructions METHODS/DESIGN: One step in the development procedure is to evaluate the implementation of the guideline and MOET-instructions in the current care. Therefore measurement of the actual care will be performed in a representative sample of 20 hospitals. This will be done by prospective observation of the third stage of labour of 320 women with a high risk of PPH using quality indicators extracted from the NVOG guideline and MOET instructions. In the next step barriers and facilitators for guideline adherence will be analyzed by performance of semi structured interviews with 30 professionals and 10 patients, followed by a questionnaire study among all Dutch gynaecologists and midwives to quantify the barriers mentioned. Based on the outcomes, a tailored strategy to implement the NVOG guideline and MOET-instructions will be developed and tested in a feasibility study in 4 hospitals, including effect-, process- and cost evaluation. DISCUSSION: This study will provide insight into current Dutch practice, in particular to what extent the PPH guidelines of the NVOG and the MOET-instructions have been implemented in the actual care, and into the barriers and facilitators regarding guideline adherence. The knowledge of the feasibility study regarding the effects and costs of the tailored strategy and the experiences of the users can be used in countries with a relatively high incidence of PPH. TRIAL REGISTRATION: ClinicTrials.gov NCT00928863